Appl. No. 09/835,007 

Amdt. Dated Mar. 18, 2005 

Reply to Office action of Dec. 22, 2005 

Amendments to the Claims: 

This listing of claims will replace all prior versions, and listings, of claims in the 
application: 

Listing of Claims: 

Claim 1. (currently amended) A method of constructing a virtual three-dimensional 
model of an object from a scanner, a data processing system, and at least one machine- 
readable memory accessible to said data processing system, comprising the steps of: 

(a) scanning the object with the scanner and thereby obtaining at least two 
two-dimensional images of the object, wherein during scanning the scanner and object 
are moved relative to each other resulting in each image being taken from a different 
position relative to the surface of the object; 

(b) processing said data representing said set of images with said data 
processing system so as to convert each of said two-dimensional images into [[a]] data 
representing a frame and thereby generate a set of frames corresponding to said images, 
said set of frames comprising a cloud of individual points, each point in each frame 
expressed as a location in a three-dimensional X, Y, and Z coordinate system; 

(c) storing data representing said set of frames in said memory; and 

(d) further processing said data representing said set of frames with said data 
processing system so as to register said frames relative to each other using a frame to 
frame registration process to thereby produce a three-dimensional virtual model of the 
object substantially consistent with all of said frames[[.]]; said frame to farme registration 
process comprising the steps of: 
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(i) performing an initialization step comprising the sub-steps of: 

(A) selecting one of the frames from said set of frames as the 
first frame; 

(B) ordering said set of frames in a sequence of frames Frame , 
for i = 1 to N for further processing, wherein Frame^ is the first frame; 

(C) setting a quality index for evaluating the quality of the 
overall registration of one frame to another frame; 

(D) setting the frame subscript value i = 2; and 

(E) selecting Frame i-j_ and Framej_for registering Frame , to 
Frame^; 



(ii) transforming the Z coordinate of every point in Frames thereby 
bringing Frame , closer to Frames, comprising the sub-steps of: 

(A) calculating for Frame s : (1) the sum of all Z coordinates Z^ mj- 
i_ = sum of the Z coordinate of every point in Frames ; and (2) the median 
Z coordinate ZmeHian i-i = Z,„ m j.i divided by the number of points in Frame;. 
il 

(B) calculating for Frame ; : (1) the sum of all Z coordinates Z^^ = 
sum of the Z coordinate of every point in Frame ; ; and (2) the median Z 
coordinate Zn grWi = Z 5 1inL i divided by the number of points in Frame^and 

(C) calculating AZ = ZmeHinn i - ZmeHian i-i ; subtracting AZ from the Z 
coordinate of every point in Frames thereby transforming the Z coordinate 
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of every point in Frames and setting Frame ; = Frame ; having the 
transformed Z coordinates. 



(in) calculating the translation matrix for Frame i comprising the sub- 
steps of: 

(A) calculating a minimum distance vector from every point in 
FrameMo the surface of Frame^ thereby creating a set of minimum 
distance vectors for Framei; 

(B) eliminating from said set of minimum distance vectors for 
Frame ; each of said set of minimum distance vector for Frame i that 
satisfies one or more exclusion criteria from a set of exclusion criteria, 
thereby creating a remaining set of minimum distance vectors for Frames 
and marking each of the points corresponding to the remaining set of 
minimum distance vectors for Frame i as an overlapping point, wherein 
said overlapping points define the area of overlap between Frame s and 
Framei ; 

(Q calculating a vector sum of minimum distance vectors for 
Frame i by summing all minimum distance vectors corresponding to said 
overlapping points in Frame i ; and 

(D) calculating a median minimal distance vector (t) i for Frame i 
by dividing the vector sum of minimum distance vectors for Frame i with 
the number of vectors corresponding to said overlapping points in Frame i 
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thereby the median minimal distance vector (Q i for Frame ; forming the 
translation matrix [TKQ;; 

(iv) calculating the rotation transformation matrix for Frame ; 
comprising the sub-steps of: 

(A) creating a copy of Frames and designating said copy of 
Frame ; Frame;* ; 

(B) subtracting the median minimal distance vector (t\ from 
every point in Frame;*; 

(C) gettng a position vector for every overlapping point in 
Frame ;* extending from the origin of the coordinate system for Frame ;* to 
the overlapping point in Frame ;*; 

(D) calculating a vector sum of all position vectors 
corresponding to all of the overlapping points in Frame;*; 

(E) calculating the center of mass for Frames by dividing the 
vector sum of all position vectors corresponding to all of the overlapping 
points in Framej * with the number of said position vectors corresponding 
to all of said overlapping points in Frame ,*; 

(F) calculating a cross-vector for every overlapping point in 
Frame ,* by performing a cross-product operation of (1) the position vector 
for the overlapping point in Frame ;* substracted by the vector of the center 
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of mass for Framej * and (2) said minimum distance vector for the 
overlapping point in Framei*; 

(G) calculating a sum of all the cross-vectors corresponding to 
all of the overlapping points in Frame ;*; 

(H) applying a weighting factor to the sum of all of said cross- 
vectors for Frame i* thereby producing a weighted sum of all the cross- 
vectors for Frame i* ; and 

(I) scaling the weighted sum of all the cross-vectors for 
Frame i* with an empirical acceleration factor f thereby creating a scaled 
weighted sum of all the cross-vectors for Frame i* thereby said scaled 
weighted sum of all the cross-vectors for Frame i* forming the rotation 
transformation matrix [T](R)j. 

(v) applying the transformation to Frame^and evaluating the results 
comprising the sub-steps of: 

(A) computing the transformation matrix for Frame ; \T\ = + 
|T1(t\+ |T~|(R) i ; and applying the transformation matrix \T\ to every point 
in Frame i thereby producing a transformed Frame i wherein \T](t\ 
produces the transalation of the X, Y and Z coordinates of every point in 
Frame i and ["T](R) i produces the magnitude and direction of rotation of 
Frame i; 
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(B) calculating the closeness factor of the transformed Framei 
and Frames and comparing said closeness factor with the quality index; 

(C) if the closeness factor > the quality index, then returning to 
step (iii); otherwise proceeding to the next step; 

(D) if i < N, setting i = i + 1 and returning to step (ii) until 
Frames is registered. 

Claim 2. (canceled) 

Claim 3. (currently amended) The method of claim 1, wherein step (d) further comprises 
the step of performing a cumulative registration of said set of frames^ , wh e r e in at l e ast 
som e of said fram e s ar e r e gist e r e d to a plurality of oth e r fram e s pr e viously having b ee n 
r e gist e r e d to oth e r frames in said s e t of frames. 

Claim 4. (canceled) 

Claim 5. (currently amended) The method of claim 1, wherein in step (d){i) on e of after 
selecting said fram e s is a starting frame for registration, and wh e r e in a spatial 
transformation relationship is derived for each of the other frames in said set of frames 
and stored in said memory, said spatial transformation relationship indicating how the 
points in said frame should be translated and rotated in a three-dimensional coordinate 
system to register said frames relative to said starting frame. 
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Claim 6. (currently amended) The method of claim [[5]]!, wherein said starting frame 
corresponds to the first image captured by said scanner. 

Claim 7. (currently amended) The method of claim [[5]]i, wherein said starting frame 
corresponds to selected image taken of the object and in which other images were taken 
of the object in the same vicinity of the object such that a substantial amount of overlap 
exists between said selected image and said other images. 

Claim 8. (currently amended) The method of claim 1, wherein, in step (d), said s e t of 
fram e s ar e r e gist e r e d to e ach oth e r in a sequential order with the ord e r is determined, at 
least in part, upon the degree of overlap in coverage of said object in said frames. 

Claim 9. (original) The method of claim 1, wherein said scanner comprises a hand- 
held scanning device and said object is scanned by moving said hand-held scanning 
device over said object. 

Claim 10. (original) The method of claim 9, wherein said object comprises a human. 

Claim 11. (original) the method of claim 10, wherein said object comprises teeth and 
associated anatomical structures. 
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Claim 12. (original) The method of claim 9, wherein said object comprises a model of 
an anatomical structure of a human. 

Claim 13. (original) The method of claim 1, wherein said data processing system is 
incorporated into a work station for said scanner. 

Claim 14. (original) The method of claim 1, wherein said data processing system 
comprises a general purpose computer operatively connected to said scanner and said 
memory. 

Claim 15. (original) The method of claim 1, wherein said data processing system 
comprises at least two independent processors sharing the processing required by steps 
(c) and (d). 

Claim 16. (original) The method of claim 15, wherein one of said processors is 
incorporated into a work station for said scanner and wherein the other processors 
comprises a computer remote from said work station. 

Claim 17. (original) The method of claim 16, wherein said object comprises teeth and 
associated anatomical structures, and wherein said work station and scanner are located 
in an orthodontic clinic, and wherein said computer remote from said work station 
comprises a computer in said orthodontic clinic. 
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Claim 18. (original) The method of claim 1, wherein said scanner, said memory and 
said data processing system are housed in a single unit. 

Claim 19. (original) The method of claim 1, wherein said data processing system is 
coupled to a user interface including a display, and wherein data processing system is 
operative to display said virtual three dimensional model on said display. 

Claims 20-32. (canceled) 

Claim 33. (currently amended) A method of creating a virtual three-dimensional 
object, comprising the steps of: 

a) scanning said object in a series of scans, each scan generating a set of images; 

b) converting said set of images into a set of three-dimensional frames; 

c) registering said frames in each of said series of scans to each other using a 
frame to frame registration process to thereby generate a series of segments, each 
segment comprising a portion of a three-dimensional model of the object; said frame to 
frame registration process comprising the steps of: 

(i) performing an initialization step comprising the sub-steps of: 

(A) selecting one of the frames from said set of frames as the 
first frame; 
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(B) ordering said set of frames in a sequence of frames Framei 
for i = 1 to N for further processing, wherein Frame^ is the first frame; 

(C) setting a quality index for evaluating the quality of the 
overall registration of one frame to another frame; 

(D) setting the frame subscript value i = 2; and 

(E) selecting Frame j_i_ and Framej _ for registering Framei to 
Frames; 



fii) transforming the Z coordinate of every point in Frame , , thereby 
bringing Framei closer to Frame ^ n comprising the sub-steps of: 

(A) calculating for Frame s : (1) the sum of all Z coordinates Z^n. 
\ _ = sum of the Z coordinate of every point in Frame s ; and (2) the median 
Z coordinate ZmeHinn ..i = Z<„m m divided by the number of points in Framej, 
li 

(B) calculating for Frame , : (1) the sum of all Z coordinates Z^r^ = 
sum of the Z coordinate of every point in Frames and (2) the median Z 
coordinate Z m ^ n \ ~ Z* um \ divided by the number of points in Frame^and 

(O calculating AZ = Z™e<\\™ \ - ZmeHian i-i; subtracting AZ from the Z 
coordinate of every point in Framei, thereby transforming the Z coordinate 
of every point in Frame i , and setting Frame ; = Frame ; having the 
transformed Z coordinates. 
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(in) calculating the translation matrix for Frame ; comprising the sub- 
steps of: 

(A) calculating a minimum distance vector from every point in 
Framej_to the surface of Frame^ thereby creating a set of minimum 
distance vectors for Frame;; 

(B) eliminating from said set of minimum distance vectors for 
Frame, each of said set of minimum distance vector for Frame ; that 
satisfies one or more exclusion criteria from a set of exclusion criteria, 
thereby creating a remaining set of minimum distance vectors for Frame s 
and marking each of the points corresponding to the remaining set of 
minimum distance vectors for Frame ; as an overlapping point, wherein 
said overlapping points define the area of overlap between Frame s and 
Frame ;; 

(C) calculating a vector sum of minimum distance vectors for 
Frame; by summing all minimum distance vectors corresponding to said 
overlapping points in Frame ; ; and 

(D) calculating a median minimal distance vector (t) ; for Frame; 
by dividing the vector sum of minimum distance vectors for Frame; with 
the number of vectors corresponding to said overlapping points in Frame; 
thereby the median minimal distance vector (t\ for Frame ; forming the 
translation matrix |"T)(t);; 
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(iv) calculating the rotation transformation matrix for Frame; 
comprising the sub-steps of: 

(A) creating a copy of Frames and designating said copy of 
Frame ; Framei*; 

(B) subtracting the median minimal distance vector (t) i from 
every point in Frame,*; 

(C) gettng a position vector for every overlapping point in 
Framei* extending from the origin of the coordinate system for Frame ;* to 
the overlapping point in Framei*; 

(P) calculating a vector sum of all position vectors 
corresponding to all of the overlapping points in Framei*; 

(E) calculating the center of mass for Frame ,* by dividing the 
vector sum of all position vectors corresponding to all of the overlapping 
points in Frame ,* with the number of said position vectors corresponding 
to all of said overlapping points in Frame i*; 

(F) calculating a cross-vector for every overlapping point in 
Frames* by performing a cross-product operation of (1) the position vector 
for the overlapping point in Frame i* substracted by the vector of the center 
of mass for Frame i* and (2) said minimum distance vector for the 
overlapping point in Framei*; 

(G) calculating a sum of all the cross-vectors corresponding to 
all of the overlapping points in Framei*; 
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(F0 applying a weighting factor to the sum of all of said cross- 
vectors for Frame ,* thereby producing a weighted sum of all the cross- 
vectors for Frame ,* ; and 

(I) scaling the weighted sum of all the cross-vectors for 
Frame i* with an empirical acceleration factor f thereby creating a scaled 
weighted sum of all the cross-vectors for Frame i* thereby said scaled 
weighted sum of all the cross-vectors for Frame i* forming the rotation 
transformation matrix [T](R) i. 

(v) applying the transformation to Frame^and evaluating the results 
comprising the sub-steps of: 

(A) computing the transformation matrix for Frame i \T\ = + 
|T](t)j_+ |T1(R)i; and applying the transformation matrix |T~| i to every point 
in Framei thereby producing a transformed Frame i wherein |T"|(fl i 
produces the transaction of the X, Y and Z coordinates of every point in 
Framei and TTKR) , produces the magnitude and direction of rotation of 
Framei; 

(B) calculating the closeness factor of the transformed Frame , 
and Frame s and comparing said closeness factor with the quality index; 

(C) if the closeness factor > the quality index, then returning to 
step (in); otherwise proceeding to the next step; 
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(D) if i < N, setting i = i + 1 and returning to step (ip until Frame^ is 
registered; 
and 

d) registering said segments relative to each other to thereby create said virtual 
three-dimensional model. 

Claim 34. (original) The method of claim 33, wherein step d) comprises the steps of: 

1 . displaying on a monitor each of said segments, 

2. prompting a user to select with a user interface device a location on each of 
said segments which overlaps at least one other segment; 

3. storing said locations selected by said user; and 

4. using said stored locations as a starting point for registering said segments 
relative to each other. 

Claim 35. (original) The method of claim 34, further comprising the step of displaying 
on said monitor the virtual three-dimensional model. 

Claim 36. (original) The method of claim 33, further comprising the step of performing 
a cumulative registration of all of said frames forming said virtual three-dimensional 
model. 
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Claim 37. (original) The method of claim 34, wherein said object comprises teeth and 
wherein said locations selected by the user in step 2. comprise locations where virtual 
brackets are placed on teeth in an orthodontic treatment planning for said teeth. 

Claim 38. (original) The method of claim 37, wherein said locations are represented on 
said display by a graphical icon. 

Claim 39. (original) The method of claim 38, wherein said icon appears as a virtual three- 
dimensional object. 

Claim 40. (original)The method of claim 39, wherein said virtual three-dimensional 
object comprises a circular portion having a center located on the location selected by the 
user and direction indicating portion. 

Claim 41. (original) An orthodontic workstation performing steps b, c) and d) of the 
method of claim 33. 

Claim 42. (original) The method of claim 33, wherein said step of scanning is 
performed with a hand-held scanner. 

Claim 43. (currently amended) A method of constructing a virtual three- 
dimensional model of an object using a data processing system, and at least one 



OraMetrix, Inc. Page 1 8 of 45 

2350 Campbell Creek Blvd., Suite 400 
Richardson, Texas 75082 



Appl. No. 09/835,007 

Amdt. Dated Mar. 18, 2005 

Reply to Office action of Dec. 22, 2005 

machine-readable memory accessible to said data processing system, comprising the 
steps of: 

(a) obtaining a set of at least two digital three-dimensional frames of portions of 
the object, wherein said at least two frames comprise a set of point coordinates in a three 
dimensional coordinate system providing differing information of the surface of said 
object, whereas those frames provide a substantial overlap of the represented portions of 
the surface of the said object; 

(b) storing data representing said set of frames in said memory; and 

(c) processing said data representing said set of frames with said data processing 
system so as to register said frames relative to each other using a frame to frame 
registration process to thereby produce a three-dimensional virtual representation of the 
portion of the surface of said object covered by said set of frames, without using pre- 
knowledge about the spatial relationship between said frames; said three-dimensional 
virtual representation being substantially consistent with all of said frames[[.]]; said 
frame to frame registration process comprising the steps of: 

(i) performing an initialization step comprising the sub-steps of: 

(A) selecting one of the frames from said set of frames as the 
first frame; 

(B) ordering said set of frames in a sequence of frames Frame ; 
for i = 1 to N for further processing, wherein Frame ^ is the first frame; 

(C) setting a quality index for evaluating the quality of the 
overall registration of one frame to another frame; 
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(D) setting the frame subscript value i = 2; and 

(E) selecting Frame^and Frame i _for registering Frame ; to 
Frames; 

(ii) transforming the Z coordinate of every point in Frames thereby 
bringing Frame i closer to Frame^, comprising the sub-steps of: 

(A) calculating for Frame^: (1) the sum of all Z coordinates Z^a- 
i _ = sum of the Z coordinate of every point in Frame^; and (2) the median 
Z coordinate Zmedian m = Zs nm± ± divided by the number of points in Frame;. 
u 

(B) calculating for Frame i : (1) the sum of all Z coordinates Zg nmj = 



sum of the Z coordinate of every point in Frame i ; and (2) the median Z 
coordinate Z m pHinn i = Z^ m \ divided by the number of points in Frame^and 

(Q calculating AZ = Z m e.<\\™ i - Z m ?A\™ i-i ; subtracting AZ from the Z 
coordinate of every point in Frame i , thereby transforming the Z coordinate 
of every point in Frames and setting Frame ; = Frame i having the 
transformed Z coordinates. 



Cm) calculating the translation matrix for Frame , comprising the sub- 
steps of: 
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(A) calculating a minimum distance vector from every point in 
Framej _ to the surface of Frame^ thereby creating a set of minimum 
distance vectors for Frames 

(B) eliminating from said set of minimum distance vectors for 
Frame ; each of said set of minimum distance vector for Frame s that 
satisfies one or more exclusion criteria from a set of exclusion criteria, 
thereby creating a remaining set of minimum distance vectors for Frame s 
and marking each of the points corresponding to the remaining set of 
minimum distance vectors for Frame i as an overlapping point, wherein 
said overlapping points define the area of overlap between Frame^ and 
Frame ,; 

(C) calculating a vector sum of minimum distance vectors for 
Frame ; by summing all minimum distance vectors corresponding to said 
overlapping points in Frames and 

(D) calculating a median minimal distance vector (t) ; for Frame , 
by dividing the vector sum of minimum distance vectors for Frame ; with 
the number of vectors corresponding to said overlapping points in Frame ; 
thereby the median minimal distance vector (t) ; for Frame ; forming the 
translation matrix |"T~|(t) ;; 

(iv) calculating the rotation transformation matrix for Frame ; 
comprising the sub-steps of: 
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(A) creating a copy of Frames and designating said copy of 
Frame ; Frame ,*; 

(B) subtracting the median minimal distance vector (f) ; from 
every point in Frame;*; 

(C) gettng a position vector for every overlapping point in 
Frames extending from the origin of the coordinate system for Frame ;* to 
the overlapping point in Frame ;*; 

(D) calculating a vector sum of all position vectors 
corresponding to all of the overlapping points in Frame ;*; 

(E) calculating the center of mass for Frame; * by dividing the 
vector sum of all position vectors corresponding to all of the overlapping 
points in Frame ,* with the number of said position vectors corresponding 
to all of said overlapping points in Frame,* ; 

(F) calculating a cross-vector for every overlapping point in 
Frame ;* by performing a cross-product operation of (1) the position vector 
for the overlapping point in Frame ;* substracted by the vector of the center 
of mass for Frame ;* and (2) said minimum distance vector for the 
overlapping point in Frame ;*; 

(G) calculating a sum of all the cross-vectors corresponding to 
all of the overlapping points in Frame ;*; 
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(FO applying a weighting factor to the sum of all of said cross- 
vectors for Frame .* thereby producing a weighted sum of all the cross- 
vectors for Frame i* ; and 

(1) scaling the weighted sum of all the cross-vectors for 
Frame ,* with an empirical acceleration factor f thereby creating a scaled 
weighted sum of all the cross-vectors for Frame^ thereby said scaled 
weighted sum of all the cross- vectors for Frame ,* forming the rotation 
transformation matrix [T~|(R)i. 



(v) applying the transformation to Framej_and evaluating the results 
comprising the sub-steps of: 

(A) computing the transformation matrix for Frame , |T~| i = + 
TT1(t\+ FT1(R)i; and applying the transformation matrix IT"| i to every point 
in Frame i thereby producing a transformed Frame i wherein \T](t\ 
produces the transalation of the X, Y and Z coordinates of every point in 
Frame i and [T](R) , produces the magnitude and direction of rotation of 
Framei ; 

(B) calculating the closeness factor of the transformed Frame , 
and Frame s and comparing said closeness factor with the quality index; 

(C) if the closeness factor > the quality index, then returning to 
step (ni); otherwise proceeding to the next step; 
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(D) if i < N, setting i = i + 1 and returning to step (ii) until FrameN is 
registered. 

Claim 44. (original) The method of claim 43, wherein said at least two digital three- 
dimensional frames are obtained from a CT scanner. 

Claim 45. (original) The method of claim 43, wherein said at least two digital three- 
dimensional frames are obtained from a Magnetic Resonance Tomography (MRT) 
scanner. 

Claim 46. (original) The method of claim 43, wherein said at least two digital three- 
dimensional frames are obtained from a processing of a at least two overlapping two- 
dimensional images containing three-dimensional information. 

Claim 47. (canceled) 

Claim 48. (currently amended) The method of claim 43, wherein step (c) further 
comprises the step of performing a cumulative registration of said set of frames. , wh e r e in 
at least som e of said fram e s ar e r e gi s t e r e d to a plurality of oth e r fram e s pr e viously having 
b ee n r e gist e red to oth e r fram e s in said s e t of fram e s. 

Claim 49. (canceled) 
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Claim 50. (currently amended) The method of claim 43, wherein in step (c){i) eae 
ef after selecting said fram e s is a starting frame for registration, and wh e r e in a spatial 
transformation relationship is derived for each of the other frames in said set of frames 
and stored in said memory, said spatial transformation relationship indicating how the 
points in said frame should be translated and rotated in a three-dimensional coordinate 
system to register said frames relative to said starting frame. 

Claim 51. (currently amended) The method of claim [[50]]43, wherein said starting 
frame corresponds to a first frame obtained of the object. 

Claim 52. (currently amended) The method of claim [[50]]43, wherein said frames 
are derived from two-dimensional images of said object, and wherein said starting frame 
corresponds to a selected image taken of the object and in which other images were taken 
of the object in the same vicinity of the object such that a substantial amount of overlap 
exists between said selected image and said other images. 

Claim 53. (currently amended) The method of claim 43, wherein, in step c) said set 
of fram e s ar e r e gist e r e d to e ach oth e r in a sequential order with th e ord e r is determined, 
at least in part, upon the degree of overlap in coverage of said object in said frames. 

Claim 54. (original) The method of claim 43, said set of frames are obtained from a 
scanning system having a scanner and wherein said scanner comprises a hand-held 
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scanning device and said object is scanned by moving said hand-held scanning device 
over said object. 

Claim 55. (original) The method of claim 43, wherein said object comprises a human. 

Claim 56. (original) The method of claim 55, wherein said object comprises teeth and 
associated anatomical structures. 

Claim 57. (original) The method of claim 56, wherein said object comprises a model of 
an anatomical structure of a human. 

Claim 58. (original) The method of claim 43, wherein said data processing system is 
incorporated into a work station for a scanner. 

Claim 59. (original) The method of claim 43, wherein said data processing system 
comprises a general purpose computer operatively connected to a scanner and said 
memory. 

Claim 60. (original) The method of claim 43, wherein said data processing system is 
coupled to a user interface including a display, and wherein data processing system is 
operative to display said virtual three dimensional model on said display. 



OraMetrix, Inc. Page 26 of 45 

2350 Campbell Creek Blvd., Suite 400 
Richardson, Texas 75082 



